Intuitive Robot Teleoperation Through Multi-Sensor Informed Mixed Reality Visual Aids

Mobile robotic systems have evolved to include sensors capable of truthfully describing robot status and operating environment as accurately reliably never before. This possibility is challenged by effective sensor data exploitation, because the cognitive load an operator exposed to, due large amount time-dependency constraints. paper addresses this challenge in remote-vehicle teleoperation proposing intuitive way present users means using mixed reality visual aids within user interface. We propose a method for organizing information presentation set facilitate communication control panels. The resulting sensor-information appears coherent intuitive, making it easier catch comprehend meaning. increases situational awareness speeds up decision-making. Our implemented on real mobile system outdoor equipped with on-board internal external sensors, GPS, reconstructed 3D graphical model provided assistant drone. Experimentation verified feasibility while comprehensive was confirmed through assessment, which encourages further developments.